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ABSTRACT • ' \ : 

Emphasizing the role of evaluation in program 
development, this publication describes the Mississippi Choctaw 
Bilingual Education Program (BECOMH i'ts philosophy, goals, 
objectives, and proposed evaluation plan. Major components of this 
Kr3 program are identified as: (1) Instruction; (2) Curriculum and 
Materials 'Development; (3) Management; (4) Staff Development; and (5) 
Parent-Contpunity 'Involvement. Areas of research and evaluation are 
identified as: (1) English as a Second Language; (2) Survey of 
Existing Educational Conditions; and*^ (3) Overall Program. Evaluation. 
Identifying s^lf-concept, adademic achieve,ment , langueige domina'noe, 
and oral English proficiency as variables be measured, the 
refeearch/evaluatibn design is describ,ed as one that will: -(1) 
determine the^setting in which bilingual education occurs; (2)' ' ^ 
describe the program -participants; (3> determine the progress of each 
program component; (4) determine the effectiveness of each component 
in causing bilingual education to occur; (5) determine the* 
accomplishments^ of the participants and the entire program. Also 
presented is a timeline chart which describes; (1) the research ^ 
question; (2) the data sojirce or population'^ . (3) ' instruI^ent or 
method; interval aM numl^er of, measures; (5) time of measure; (6) 
person responsible? and (7)' method of analysis. (JC) 
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The ^Choctaw Bilingual, Education Program (P.ECOM) , is in its ■ 
^second year of operation. The first year was primarily devoted 
jt'Q the development of instructional and program modeli; 
• ;acquisition and pre-service training of staff; and the deveiopmenii 
of communication channels between the Choctaw Biiinguai ^ 
Education Program and the BIA-operatea schools iti which'the 
program operates.- During the first year, evaluation was • 
aGcomplished through the Center for Applied Linguistic^ The 
evaluation provided for the (^eterminatibn of management . f 
priorities" and delineation of . program objectives ! From such- 
planning and evaluation, it was detei'mined that "^the Choctaw 
Bilingual Education ' Program must have its own evaluation com- 
;ponent and doA/elop an evaluation design which meets the needs ' 
jof . the' local program. This design is the »first step in the , ' 

.development of such an evaluatiop- design . 

In general, changes in program activities and priorities * ' 
instructional methods, teaching procedures, curriculum, and " 
jclas^-oom management have taken place after trial-qaid-^error and 
after ^some experience in the ''local program.' Like most bilingual 
iprograrns, this program is still e|cplol-ing alternative courses 
inaction tO improve its services and the results of 'systematic 
evaluation efforts Will provide general' guidelines for positive . 
^program changes. . .'*'•. ' » • . 

i • , ^ , < ' _ . 

iOther bilingual programs^ have dociimented positive' achiovment in 
jStudent attitudes an'd. student academic j)rbgr ess. ' Never.theless? , 
;areas for improvement in -program planning, and development 
fare .;(nitinuously beiflg inYestigated. In brde-r to determine . the 
correct avenue" for such improvement., tliis design will be 
multivariate and Involve-rf 'sumiriative evaluation'. Additional Iv 
this design will begin to develop. a formative or diagnostic 
evaluation design for- the entire Choctaw Bilingual Program. « 
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The particular ^characteristics of aft eWluation design are 
ijelatjed to, and in some sense dictated by, the specific gdals 
a^nd pbjectives of the programi. The evaluation design for 1975-*-76 
considers the stated goals of the Chocttj^w Bilingual Education 
Rrogram' g l)ropdsal^, "and follows estaalished^^Title VH guidelines*. '* 
This evaluation design reco^fnizes tlie multiplicity of the gqafs^ 
df the Choctaw Bilingual Program and its relationshij^ t^ 'the 
BIA-operated schools. . ^ 

This de.sifrn takes Into account the fact that certain goals are 
measurable over a short time span and that others are long range. 
The la^tter requires lonf^itudinal study. This design then attempts 
to avoid the common pitfalls that characterize many eya\uation 
Offorta. These pitfalls include; undertaking, produi^t evaluation 
when the program Is in early developmental ^stages ; assessment of^ 
the accomplishments of progjram goals without t^ie delineation 
df detailed performance objectives and attempting to assess long 
rang.e goals by examining' short range developmenta. . . 

R^earch has shown that evaluation ^^i^st; be more thjin simply 
testing, grading^ and classifying for' tl^eatment, c'ea:*tain ^students. 
Evaluation must make a positive cohtrj^bution to the development 
of the program and thereby contribute to the impx^ovement of 
learning and teaching. '° ' . 

... • 

The purposes of .the Choctaw Bilingual Education evp.luati5n - 

l^rogram are : . * 

1. tf) systematically collect information to determine whether 
I -certain changes are taking placQ in studpi^ts; 
^. to assess student progre&s in order to provide BECOM staff 
j with th(^' necessary informati^on for the prescription of 
] • alt tn^iatiyes which migh^ be needed for learning development; 
3. to assess the degree of discrepancy between progrf^m objectives 
and program performance; 



to evaluate the 'development of^the products of jthe program, 
the process tfr activities leading to the products, and^ ' 
conditions needed to sustain the educational service; 
to acquire evidence that 'will lead to improved* learning^- 
and teaching^ * ^ ' . , ^ 

to determine the most efficient evaluation methods and 
instruments that will provide the necessary input for 
pi'ogi^am development ; ^ / 

to perform all evaluat.ion tasks detailed in the evaluation 
doHign oi this document. ' ' ' 



Bilingual Education^ for Choctaws of Mississippi 

T^he Mississippi Band of Choctaw Indians is bomposod of .approxi- 
raateljr 3,700 Cljoctaws' located on ,or near seven small reservprtion 
Qommunitiel in East Central Mississippi. Members of this tribe 
are the descendents of those Chpctaws who refused to leave their 
homeland when the majority* of the Choctavv* were moved west of 
^the Mississippi River during the 1830's, 1840's, 1850's and 
1903. Despite a sonftimes unfriendly raacro-^sbcietyv this tribe 
of Indiana has retained its ethnic identity (well over 90 
percent are classed as full--bloods" ) and native language 
(rdughiy 95 percent of the people speak Choctaw in their homes) 
in the past by purposely not assimilating to any. notipeable 
extent with the other rjices s,urrounding them. , Throujjhout most 
of their recent history, they have lived as an isolated, poverty 
Striken, rijral minority in an area where the* dominant popula- 
tion is composed of "Blacks" and "Whitejf". .Out of\ total of 

1 ■ * \ ' » 

912 familiof^ in 1971, 772 families rjpceivod ^public assistance 

from either the State or from the Bureau of Indian Affairs. 

There are roughly seven ' dialects. of Choctaw spoken in the seven 
ejDmniunities today. TJiese are (1) Pearl River, (2) Tucker, 
(3) Standing Pine, (4) Red Water, (5) Bogue Chitto, (6) Bogjie 
Homa and (7) the Conehatta community. There are also dialectical 
variations, between the Oklahoma Choctaws and the Mississippi 
Choctaws. However, a native*£?peaker of the language does not ^ 
l|ave insurmountable problems with the dialects. TheVe is also 
very little printed material in the dhoctaw language; thus, 
dppro??imately 98 percent#of these people are illiterate in 
iheir own language. ; 

f 

The (Ihoc taw language has had a written form for over 150 years. 
The school system developed by the missionaries and supported 
by the Choctaw Nation before- the first removals of the Nineteenth 
Century used textbooks printed In English and Choctaw. The 

■ ■ ■, , 5 " • 

8 
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'•'public" system ^egun in nGighborhood churches in the 1890 's 
also utilissod a bilingual ^approach.. Unfortunately , ^ this practice 
did not continue whe^n the Bureau of Indian Affairs initiated the 
present system. ^ . 

The present system operates elementary ''nelghbox^hood" .schools 
in fii^e of the seven reeervatidii communities and- a K-12 school 
in another. The remainin?^ community, Bogue Homa, is the smallest 
and mM^^^t d i stdnt .community ^ and sends its children to a public 
acho^^J . This B.l.A. system has an enrollment of over 1,250 
students and employs appro^imatoly 65 classroom teachers- .Only 
ten of these teachers are Mississippi Choctaws and they are the 
t)n% teachers who can speak .the native language of the students.. 
l!he prr^sent system was set ^up in 1920 but a high school was not 
established until 1964. Prior to that time, very few^Choctaws 
completed hifth school 'due to social (segregated Mississippi 
&^oclf-ay) and economic reasons.^ , X 

•Almost all Chocta^v children are fluent spealjer^ of Choctavv when 
tjhey enter school; the remainder, for the most part, can \ 
comprehend Choctaw. Choctaw adults use Claoctaw in almost al4 
c:ommunity circumstances among themselves. ^ The same is true for 
children, teen-agers, and young adults. Most childrc^m speak 
little or no English when they enter school. Those who do not ^ 
speak Choctaw upon entrance into the Choctaw school system tend! 
to 'succumb rapidly to peer pressures and acquire Choctaw,' usually 
cilt great expense to thcur English. Thus,- Choctaw. can' be 
considered to be the n^itlve language of the children, whOther 

i.e. ^ ... 

directly, by acquisition in the home, or indirectly, by 
alcquisition in the school environment. 

6 

Prior to the dhoctaw Bilingual Educ^ition Program, .there were 
only minimal programs for the (non-English'-apeaking) Choctaw 
in the native language. • These involved primarily adult educa-- 
tion courses and, in solid case.^. Head Start instruction. The 
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school classrooms were English in orientation utilizing Aides 
in the translation niodel, 

' * ^ . • ■ 

*rhe Choctaw Bilingual Education program was begun in 1974 
jthrbugh the funding^of Title VII. In the 1975-76 school year, 
the BlSCOM program began iinplementing bilingual education in 
grades K and 1. ESL instruction under the supervision of BECOM 
occurs in grades in each of the 6 BIA operated schools. 

A Septembor 1975 census of pupils in. the target grades, at the 
six Choctaw schools is provided below. ' 



Choctaw Central 



Kindergarten 31 

1st Grade a9 

2nd Grade 25 

3rd Grade 42 

Total 117 



Conehilitta 



Kindergarten 
1st Grade 
2nd Grade 
^d Grade 
Total 




'Bogue Chit to 



Kindergarten 
Ist Grade 
2nd Grade 
3rd Grade 
Total 



Tucker Day Schoo 



Kindergarten 
1st, Grade 
2nd Grade 
3rd Grade 
Total 



19 
14 

w 

9 
12 
54 




Standing Pi'ne 

^KindcrRarten 
Ist Grajde 
2nd Grade 
3rd e^rade 
' ' Total 

Red Water Day School 

Kindergarten 
1st Grade 
2nd Grade 
3rd Grade 
Total 




8 
9 
12 

_JL 

33 



TOTAL 



334 
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. ■ Philosophy ^ ' * . • 

The Choctaw Bilingual I^ducation Program provides sa bilingual 
curriculum -for the Choctaw children which facilitates the • ' ; 
child's developmental processe"s and educational grdwth in 
cognitive and affective areas and establishes a mechanism for 
effective utilization of -the- child' s educational and -economic" 
potential . • o , 

Choctaw bi 1 ingual education is not a remedial or compensatory 
program, « It is a complete educational program with the added 
enrichment of s°ystematic training in a secaand language" (English 

The educational approach being developed by BECOM for K-3 ' 
can be characterized briefly as follows: ■ ' ' 



READING 



INTRODUCTION 
OF OTHER 
SUBJECTS OR ■ 
CONTENT AREAS 

tEACHING OF 
•THE SECOND 
i;.ANGUAGE . 

'TEACHING ROLES 
AND RESPONSI- 



IflLITIES 



INTENTION OF 
PROGRAM 



Introduction of read^g^n^the ,flrst language 
(C^ioctaw) until the child regies- hie reading 
grade level,- then the intu^oduc^on of reading 
in tlie second, language (English) ; 

The home language (Choctaw) will be vised "as " 
the medium of instruction for other subjects^.; 
gradulilly th^ second language (Erigligh^ will 
be Introduced as a me°dium of instruction. 

>■ ■ 

English will first be introduced as an oral 
subject in structured and ordered form - 



A team teaching approa'ch is necessary; Choctaw 
aides, under the supervisipn of certified 
teachers, will teach readingoand other subjects 
in Chofttaw; teachers' wilf be' rosponslbl© for 

"teaching English, as well S.s providing support 
and. guidance to the Choctaw aides and monitoring 
pupil a'ctieities taking place in -Choctaw. 
(Where the class is headed by Choctaw teacher, 
the classroom responsibilities will be divided 

"Equally), ^ . y/ 

Early education will be in Choctaw; later educa- 
tion will basically be in English, with ah " 
allowance for -the use of Choctaw as a medium of 
instruetloh as" needed or desired; full literacy 
will be developed 'in both- "Choctaw and 'English. 
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This approach has beefi locally adapted froni«,a chax^acterization 
of bilingual education by P. Engle in "Langifage Medium in 
Ea,rly .School Years for Minority Lan^age Groups'* (Review of 
Educational Research , Spi^^ng> 1975, Vol. 45, No. 2, pp 283^325) 
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.T|he ma^dr' goals of. the BECQM^Program parallel th^ five pomponents 
(Outlined by;^; the Title yit guiflel^es: : . ' - ^ 

).4,.;;An'^, lAgtructlonal Component which pirovides for the individual 
;4 needs .or th6 pupils , S4sang" emiriculum ma;tQrdals which reflect' 

I the-.G^ltural. and -linguistic, background qj the participants; 

B; a. Curriculum ' and Materials Dey'felopment Gompofient whi^h ■ 
V coasider^ tire '^pec^al interests and tn'eeds of the "pupils 
^ : ,atfd s^tr esses J.a'liguage and'cultiira^ studies as .well 'as the- . 

, " deve-la^me^it of ■ positive self-concept; \ ' a • 

' A Management Common en-t which maintains' responsibility . for 
. implementing and- ajiininl^ ^ilirigual-biculturai programs ; 

B-, A StaJf ' Developmefit Component which ' elicourages contiguous 
■ \ teacher->t;raining in bilijigual-jDicuXt^ral education to provide 
, a school program that- i's viable ,and relates to "tlie needs of 

. ^ the pupils arid thre ccanmuhity ; . / ' ! > • ' 

,3p^A Parent-Community Involvement ' Component^ which involves 
1^ parents and other community members; in school related 
! funcvtions jof^ the program, i , V ^ ^ . . 
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. ; Objectives foj, t'h6 Choctaw Bilingual Education Program . 

" • ■ : , ,• • . ■ ■, ^ • ' ■ . ■ • ■ 

Lon ^'" Range- (fivg-year) Ob.1 act lyes >. . - .■ ■ . 

'During the 'courie/of - the .existence ,of the Chqctaw Bilingual/\ 
^ • ' . \ • ■ ' , ■■•■*."'•• \ 

' Education -Program' the following will be accomplisbed: ^- ^ ^ 

■■ ' ' ' . . ■■ ' / < ■ ' 

" ' ' 1 . ; Students will' demonstrate a significant /increase in 
achievement, motivation as re^^istered ; in teachers' 
- , ratings and 'objectives, ins'jbrumentv. 

2, students will^ demcJristrate kn appreciation of their- , ^ 
" traditional Choctaw culture and its values, 

3. Students will expxess positive feelings abput them- 
selves as registered by BECOM developed ^in^trument. ^ 

47 Students will demonst:rate arf; understanding Of main- 
j^^stre^ American culture and its relevance- tb theiy 
r present lives. ^ 

i ■ . ' ' '* ' ! ^ . ^, . • 

5. Students will make significant improvement in their 
i ability, to speak fluent Choctaw and to. becomes 

expressive in it. ? - ' ^ 

I 6. students will make .significant injprovement m their 

ability to speak fluent English and . to become | 
^ expressive in it. 

• Note,:. Since 'the .model upon which the program-will b^ built . 
i ' is a continuous ,p'rogress one jra.te of growth In 

! reading skills wi-11 depend to a considerable, degree 

V on the developmental profile of each,^ individual • ^ 

j the case of an ability .to read tjid Choctaw language, 

1 contingejicies surrounding language difficulty, as. 

i yet undetermined, will- also influence rate of growth . 

■ .^Minimal mean progress in English ^ language development, 

: however, will be prqgr,ammed to approximate one year 

: 9f academic growth for each year of schooling , such , 

^ growth to be measured by the Reading and Language 
Subteq^t of 'the Metropolitan Achievement Test'. 

7. Students will . develop mastery of the basic literacy ^ 
j . skills of decoding and encoding in Choctaw in Grades 

I ' 1 through 3, This will be defined as: 

j: I a. the ^ility to read with ease new material' at 

I ' grade level (e.g. , reading in content areas, such 

I ; as social studies, science materials and story books); 

; . b. I^he ability to compos© aad, write short , personal 

— notes to friends; and , ' ' ' 

/ c, the ability to read (take information from the 
printed page at a rate equal- to or' greater than 
the normal spoken rate)*^ ' ^ . " 

Project staff will develop instruments to determine 
the above. . * , 

• . ; *" 11 . ^ 



Long' Range Objectives (con^ t ) 

j 8. Students will enter a program of English reading and 
. ' ' writing after mastering tt^e basic literacy skills / ' - 
* (see ^ it em 7 above). v. ^ * * 

9..^,Students will reach grade level within two years after 
' entering the English program and thereafter, will 
[ make anoaverage gain of one academic year in grade 

" equivalent scores on thg Reading Subtest of the 
Metropolitan Achievement Test. " o , 

10. Students will de^^op an understanding of the structure ' 
of the Choctaw lanfcua^e appropriate to a child in their 
respective grade level. 

-11. Seventeen Choctaw tqachers' aides within the Choctaw 
School System will be trained at the program sites . 
/These aides will be trained to: ; , 

a.' sipestL, read and write the Chojb^t aw language , and 

' oh. conduct the methodologies required for classroom. 

implementation of a 'bilingual' educa)tion 'approabfe^ 
"u, emphasizing cultural equity. 

12. Seventeen teachers' aides will .obtain college credit . 
- ' - for a portion of their work irf the BECOM Program 

during the summer institute and the end of Program ^ 
' Yea:t* 1, thus, advancing on the "career ladder'V, 
leading to teacher certification. 

i ; 13. Project staff will complete development and ImplQ- 
! mentation of at least the fallowing curriculum^ ^ 

i materials in the Choctaw language for use within the 

! ' * Choctaw School System: , * ' 

I . . a. a language arts resource book in the Choctaw language; 

j b. a handbook for teachers and aides of the Mississippi 

Choctaw bilingual Education program; 

* c. a basal reader written in the Choct;tw language 

; for the third grade students; 

d. story books using the Choctaw legends written^in 
the Choctaw language for each of ^the grades; 

e. .twenty-f iV^e (25) science units written in both 
J larrguages. for grades K-12;. 

j • f. * twentyrf ive (25) social studies units written in 

{ ' both *languages for grades K-12; ^ 

J * g. forty (40) math units written in both languages for 
; ; . ' ^ grades K-^2; \ . 

: h. the project staff .and teachers will revi^ew the • 

various ESL materials and select one or develop a 
modified version of existing ESL program that 
will hfiist provide^ the curriculum heed of ekch grade 
level in BECOM project. ' , 
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Long Range bb.ject Ives (coit't) 



14, 



15. 



16, 



17. 



i. an up-to-date Chobtaw dictionary (CJioct^^to 
English and English to Choctaw) using X^q • 
different di-alects of the Mississippi 0hoc taw 
language; / ■ . ^ / 

j. a Choctaw culture, history and packagG, of materials 
vfor both elementary and secondary level. 

Project staff will complete development and implemen- 
tation of at^ least the following classroom procedures 



and methodologies for util^ization 
Bilinqual' Education Program; 



'in the Choctaw 



a bilingual approach, to language development 
emphasizing cultural equity, ; 

utilization of the language bf^ the /'students to 
increase their fluency in both languages'- 
(English and Choctaw), 

utilization of the language of the! students -to 
stimulate their fluency* in both Ito'guages 
(English and Choctaw) „ 



lement of parents 



Project staff will increase the ihvoli 

and community leaders by developing am offering^a 
program of adult literacy in Choctaws which will 
enable them to read the following levMs: 



a, 



■ Reading 
1. 



2. 
3. 

4. 



ability to read with ease inie^ch ofg the two 
orthographies in current usfi^^fscho©!" ortho- 
giraphy, traditional orthpgr^phy); -^ 

ability to read" aloud for audlerices satisfactorily; 

lability to use reference materials (e.g. , grammar , 
.dictionaries, etc.)i ♦ 



ability to' use study materials '(e. g. , English, 
through Choctaw, Choctaw language arts, etc.). 
b. Writing, 'i ■ ^ 

1. ability to Write personal letters; 

2. ability to keep personal records and notes 
(e.g., shopping list); . . 

Project staff will teach the educators in the Choctaw 
School System .the grammatical differences between 
the two languages so that they .can understand the 
difficulties the Choctaw- speaker finds in English. 

Project staff will develop an annual orientation and ' 
in-service training summer workshop on the Choctaw 
language for the, educators, of Choctaw chil'dren that •. 
■will continue &,fter Title VII' funding ceases. - 
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ft. 

Long Range Objectives (con't) j 

the* j^ollowing^hart shows 1?he Irelatiohship between the 
i)rogram objectives and the prograril components.^ ^ ' 



Component 



Program Objectives' 
1 2.3 4 5 6 7 8 9 10 11 l2 13 14 ife 16 17 



i ? 





■ INSTRUCTIONAL 


1 


X 


X 


X 


r 

X 


X 


X 


X 


X 






X 


1. 


X 


x 






X 


B. 


_(:URRICUEUM AND 
MATERIALS- DEV. 




X 


X 


X 


X 


X 




X 


X 


X 


X 






x 




X. 




X 


c. 


MANAGEMENT 




• x 


X 


X 


X 


X 




X 


X 


X 




X 


K 


X 


'1 






X 


D. 


STAFF DEVELOPMENT 




X 


X 


X 




X 


X 


X 


X 






k 


X 










X 


■ E. 


parent-communitJy 
involvement 






X 




X 














.,i 






1 ■ 


X 

} 


X 


X 



f <i 
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STRATEGY MODELS 



,/ 



There are two kinds of models, that ^must be distinguishe^i, 
T'tiese are the instructionfil model and the program modeJX. 
The instructional model 'refers to the organization of <the 
bilingual classroom, and the materials that are to be ^ut-ilizQd 
|in that classroom as well as the role of both the teacbyer and 
laide. The program ipodel refers to the longitudinal deyelopmeni: 
of the child as he jprogresses through the bilingual program. 



The instructional model that ^i^^ advocated by th^ BECOM program 
:for use in tb.e bilingual' clas'^t'optns in' tjhie' Choctaw schools* is 
the Self -contained model . Iii' th;is mode}: there is o.tte teacher, 
several bilingual aides, and.one cIb^b ot students in that 
learning environment ♦ Students receive iustruotlon in .all 
^ubject matter areas from th^e teacher and the bilingual aides. 
fThe advantage of this model: over other models is tlrat it 
Iprovides a comprehensive bilingual-bicUltural education.. This 
tttq^el furthermore, takes advantage o't the -team-teaching approach 
:and the strengths of both the teacher and the bilingual aide, 
jin the Philosophy section of this docurt^nt an outline of the 
teaching roles is presented. • 



The program model for the Chocta,w BiJLingual Educatio'n program 
Is, in effect, four models. These program models coorelate 
with the grade level of the student in the j^rogram: model one 
jis used, for kindergarten; model two, for Ist^ grade; modal three, 
[for second grade and model four for 3rd grade. . ^ 



.pPime allotments for linguistic balance, vary from the first year 
jtb the fourth year. These are based primarily on the predicted 
ievel of mastery of the second language. The following chart ^ 



jguramarizes the long-range Iprogram expectations. 

T?ime alio ted by Model 1 ^ Model 2 

Language of. I nstruction 

Choctaw * ; 



Model 1 ^ 
Kindergarten 



1st Grade 



Model 3 
2nd Grade 



Model 4 
3rd Gmde 



English 

(time allotment '.variation 



95% 

5% 
■ 10%) 



95% 
5% 



75% 

25% 



„ 60% 
405 
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. '■ RJiSfi ARCH. A^ID EVALUATION DESIGN, ' ^ \ . 

a 

General Statement of I ntent " ,» . 

_ — , — , — ^ , — t> 

The research and evaluation design fo,r the Choctaw Bilingual, 

Ejducat ion Program f(3r 1975-76 provides, a unified framework 

ejQCompassihg all ^components of the bilingual program^. The 

use of one desiign to evaluate all components of the program will 

facili-tate coordination of efforts .in those various components. 

Additipnally , from such ^ design it wiLl be* possible to determine 

the factors of the compoaents which are^most effectivevin ' " 

achieving the- desired" program goals. 
* 1 A . * 



As the 'Choctaw Bilingual Education Program serves all children 
in grades K-3 in* the Choctaw schools, the use of comparisons 
between populations as an evaluation design is precluded, 
Tfherefore, the primary focus of the design must be one wltich will 
(;a) determine ihe setting in which bilingual education occurs*, 
(lb) describe the participant's of the jrro'grafl^,. (c) determine the 
progress of each, component of the program, (d) determine the 
ejf f eiitiveness of each component in causing bilingual education- ^ 
• tlQ Jiappen in the Choctaw sqhools, and (e) determine ,the accomplishments* 
oif the participants and the entire -prSgram. 



livie 'to the nature of the Choctaw Biliitgual Education Program 
a^nd its relationship to the Choctaw schools, the^ information 
that is derived by implementing this evaluation design will 
tie utili:aed not only in the planning and development of the 
dhoctaw Bilingual Education Program, but also will be made * 
[^vailable to the proper school officials so that institutional 
Changes may be accomplished which will facilitate teaching 
4n4 learning. in the schools. 

In order* to accomplish these comprehensivG evaluation and 

reporting tasks, it will bo necessary to measure a variety of 

variables in all schools. Variables which will be measures in 

the schools are: academic achievment (MAT), self-cd^if&ept , 
\^ 

languago dominance, Oral English ProficiGncy, and other variables 
measured by classroom observation and management questionaires , 



To devey/(p the proper training program it will be necessary 
•to investigate teachers' and aides', cla^srqom and professional 
-skills in bilingual methodologies. Furthermore, an evaluation 
of the; BECOM developed materials will be utilized to provide ^ 
ifeedback' tt) program developers as' to the efficacy of the 
Materials . 

the Choctaw Bilingual Education Program is developing its ; 
evaluation component as the ather component's are being developed, 
t^e^ovaluat ion component must -determine the most efficient 
methods ar>d instrumen»ts for use.i^n determining the accorflpi'ishment 
of th^ program as well as for providing input" irito program 
development.. Thus, much of the evaluation effort' will be 
given to the development pf evaluation instruments. 

Thie following questions will guide, the. de;velopment of 

;the evaluation instruments, for these questions quided the 

'determination of the- evaluation tasks to be accomplished. • 

1. What iis the setting for Choctaw Bilingual Education? 

2. What professional shills are necessary for teachers and 

j aides to implement bilingual education and to what degree 
I . do teachers possess these skills? - ^ 

i3* What instructional activities are the most effecliive in 
I accomplishing Choctaw bilingual education? " 

'4.* What is the' status of language parity and its relationship 
to school achievmen't and/or self-concept? - . . 

,5. Do children in Choctaw bilingual classrooms show improvement 
; in content aretis, ESL and the affective areas? 

j6. Are paronta aware of aii^ involved in bilingual education? 

jSpQeif ic Ar^as of Research and Evaluation " 

.Three major areas of research and evaluation are envisioned, 
ipor oach of these, available instruments for use will ,be 
;reviewed 'and if necessary local instruments developed. 

Area I : English as a Second Language 

Area II: Survey of Existing Educational Conditions 

Arpa III Overall" Program Evaluation - * . 



Area I: EnRlish as a' Second Language » ■ ' ' 

To provide the necessary background for tjhe development and 
.imple^mentation of the ESL program, ijb is necessaa^y to assess* 
the, current English levels and language dominance of the pupils 
in grades K-3 . 

Oral English Proficiency , . The CORE Esl materials were selected 
for use in oral Engldsh^instruction and a test of Oral English 
Proificiency is necessary for the determination of the begirming • 
^ lervels -of ins-fttuction. The instrument to be used here must be 
comprehensive and provide for a measurement of' the .prof iciency 
in the English structures that are to be covered in the ESL 
program. The oral English proficiency screening and normative 
tables will be completed and input into the ESL program 
iqr prescriptive use by the end of the year. 

Language Dominance . The overall goal here is to have by the 

end of the year both an objective instrument to use -to measure 

' ■ . ^ . ' . ■ ■ . ^"^^ . 

language dominance and a subjective- measure for use by the 

teachers in assessing the^child's language dominande. The 

objective measure must be easily administered in just a few 

minuted by the evaluation staff, while the subjective measure 

must be clearly designed to allow the teachers to accurately and 

rpli^ably measure the child's language dominance. The procedure 

^^/ill be to administer both the objective and, subjective 

measures to the pupils and to determine which measures with , 

suitable accuracy the child's language dominance. The, most 

s,ui table measure will be used in future yeare. Once the 

oSbjective rating has been completed, normativo data will be 

cbl nK^ted and normative tables prepared. By the ead of the 

ybar, then, a brief, workable, reliable measure of language 

domlnancG will be completed for teachej' xise. 

Tke^ followi ng is a tentative calendar for the eompletioii of the 
evaluation tasks in Area 

September - Devise Subjective Lajiguago Dominance Assessment 
instrument, distribute (with instructions) to 
» teaehQrs and aides for completion and return. by . 
/Oct 15. 



October - 
Noveinb.er - 

•i i ' . 

December - 

arainuary - 
February 



,19 

Develop Objective Language Dominanc.e instrument, 
review available, Oral English Prof icienct tests and 
select appropriate instrument. ' 

0 

Test Objective Language Dominance instrument with 
30 kindergarten pupils at^'Choctaw Central - 
Begin administration of Oral English Proficiency ' 
instrument to all children K-3. V 

Complete administ^:ation of Oral English Proficiency 
Test , • . 

Administer -Language Dominance Test . . 

Analyze results from the above three measures 

Report results in terms of coorelations and ' 
descriptive summaries ^o'BECOM . 



Area II: Survey of Existing Educational Conditions . 



As much od the assessment of the accomplishments of the BECOM 
program will result from the.evaluation of the longitudinal 
gains of the pupils, it is necessary that baseline data be 
collected in school year 75-76. ' • 

Baseline data must be collected in the following* arpas: 
math (at each grade), reading (at each grade level , in both 
(bhoctaw and English), oral English (at each grade level), self- 
Ooneept (at ^ach grade level) and other baseline data as may • 
be requested- by the program director* 



/ 



ERIC 



This baseline data furthermore, will be utilized for the 
determination of the progress of the Bilingual ^Education 
Program during the year 75-76. A tentative schedule' for 
the colIeq,tion of that data is presented in the Overall 
Progrxim Evaluation, Area III. 



Is ■ ^ - 

Area III: Overall Program Evaluation. 

t : , \ 

Since, the thrust of the evaluation for the BECOM program 

4s' dual, it will be necessary to provide for an evaluation ^' 

, {hat assesnes the a(?,eomplishmonts of .the program while providing 

tiho 'program developers with the necessary forma'tive data for 

the development and refinomOnt of the program. To accomplish ; 

this task tiie program evaluation will ask and answer a 

series of research questions. A multivariate analysis of the 

results from that questioning will provide evidence as to the 

effectiveness of certain aspects of the program (for ref inemcnl^ 



/ 



22 



20 



as we|l as p^roviding input "into the, d©velopemtn for future 
aspects of the program. 

i \ * . . \ 0 ! 

Tsables I - V are the' tentiitive timetables for overall 
program evaluation. Tn " • . ** 
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: ; .INSTRUMENTS * . . ^ - 

fi^ll instruments developed by the BECOM program for-' evaluation 
purposes, will be completed and tested two weeks prior to 
ijmi/lementiatiott. Copies of those instruments will accompany 
s^ny reports reflecting their use and are available upon request 
.from, the BECOM program, . • . : 




